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POINTING DEVICE FOR DIGITAL CAMERA DISPLAY 



Background of the Invention 



1, Field of the Invention 



The present invention relates to digital cameras and, more particularly, to a 
pointing device-based graphical user interface that uses the camera display. 

10 2. Description of the Related Art 

Digital cameras have not generally used pointing devices to interact with the 
interface presented on the display. Typically, they use a set of push buttons to step 
through menus and to select images from memory for display and deletion. New 
15 digital cameras may rely on micro display devices, instead of the now more common 

panel display. To view a micro display, the user needs to hold the display close to his 
or her eye and view the display through an eyepiece. This arrangement makes the 
interface controls more difficult to use, because the user will not be able to see the 
controls while viewing the display. 

20 

United States Patent 5,808,678, Yuji Sakaegi, entitled "Method and Apparatus 
for Designing a Position on a View Finder Based on Motion Detection", which issued 
September 15, 1998, describes the use of a switch, trackball, joystick or camera- 
motion controlled cursor to interact with the interface presented on a digital camera 

25 display. In the case of the switch, trackball or joystick, it is awkward to designate 

locations or icons when looking through the camera veiwfinder because the user must 
hold the camera while manipulating the controls. In the latter case, the motion of the 
camera is used to move the cursor about the viewfmder interface and select icons 
therein. This interface is also awkward to use, however, because the motion causes 

30 the cursor to wander around the viewing area in an unintuitive way. 
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Thus, it can be seen that modem user interface techniques impose ease of use 
and functionality limits upon digital cameras, and hinder the use of these cameras in 
many applications. 

Therefore, there is an unresolved need for an improved user interface technique 
that can increase digital camera ease of use and functionality by quickly, accurately and 
robustly permitting cursor control and designation in a digital camera display. 



10 SUMMARY OF THE INVENTION 



A process and apparatus is described to improve a digital camera user interface 
and increase ease of use and functionality of a digital camera by quickly, accurately and 
15 robustly permitting cursor control and designation in a digital camera display. 

A digital camera is used as a pointing device such as a mouse or trackball. The 
motion of the camera is detected, and the motion of the camera is used to position 
graphic elements on the camera's own display. The camera's motion can be detected 

20 with sensors, such as gyroscopes, or the camera itself can be used as a motion sensor. 

One application of this involves using the camera as a computer mouse, or like a 
gun-sight, to select images from a sheet of low-resolution ("thumbnail") images. The 
motion of the camera is tracked, and the user aims at the desired image from a sheet of 
thumbnail images. The thumbnails appear to be fixed relative to the world because the 

25 camera can continuously reposition them in the display based upon the motion of the 

camera. The user can then select a thumbnail in an intuitive manner by simply pointing 
the camera at the desired thumbnail 



30 



For alternative embodiments, the interface can be used to select regions of 
greater extent than can be viewed in the viewer or to virtually review images. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The invention will be readily understood by the following detailed description 
in conjunction with the accompanying drawings, wherein like reference numerals 
5 designate like structural elements, and in which: 

Figure 1 is a block diagram illustrating a pointing device-based graphical user 
interface system for a digital camera display according to the present invention; 

Figure 2 is a diagram illustrating a digital imaging system having a pointing 
device-based graphical user interface camera according to the present invention; 
10 Figures 3a and 3b illustrate use of the camera as a pointing device to select 

thumbnail images according to an embodiment of the present invention; 

Figure 4 is a diagram illustrating how the thumbnail images of Figures 3 a and 
3b are made to appear to be motionless relative to objects of the scene; 

Figures 5a and 5b illustrate use of the camera as a pointing device to select a 
15 portion of the scene larger than the viewfmder according to an embodiment of the 

present invention; 

Figure 6 is a diagram illustrating heads-up display of status information 
according to an embodiment of the present invention; 

Figure 7 is a diagram illustrating use of heads-up data during a guided swipe of 
20 a panoramic scene according to an embodiment of the present invention; 

Figure 8 is a diagram illustrating tracking during virtual review of the 
panoramic scene according to an embodiment of the present invention; 

Figure 9 is a diagram illustrating image manipulation according to an 
embodiment of the present invention; and 
25 Figures 10a and 10b illustrate use of the camera as a pointing device to select 

thumbnail images for high resolution page layout according to an embodiment of the 
present invention. 
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DETAILED DESCRIPTION OF THE INVENTION 

Embodiments of the invention are discussed below with reference to Figures 1- 
10b. Those skilled in the art will readily appreciate that the detailed description given 
5 herein with respect to these figures is for explanatory purposes, however, because the 

invention extends beyond these limited embodiments. 

The invention described here allows a digital camera to be used as a pointing 
device such as a mouse or trackball The motion of the camera is detected, and the 

10 motion of the camera is used to position graphic elements on the camera's own display. 

The camera's motion can be detected with sensors, such as gyroscopes, or the camera 
itself can be used as a motion sensor. One application of this involves using the camera 
as a computer mouse, or like a gun-sight, to select images from a sheet of 
low-resolution ("thumbnail") images. The motion of the camera is tracked, and the 

15 user aims at the desired image from a sheet of thumbnail images. This application is 

illustrated in greater detail below in connection with figures 3a, 3b and 4. 

Figure 1 is a block diagram illustrating a pointing device-based graphical user 
interface system for a digital camera display according to the present invention. In 
20 digital camera 100, an image is captured by image capture unit 110. The image 

capture unit 1 10 can be selected from among the many such devices known in the art. 
Preferably, image capture unit 1 10 will be either a CCD or CMOS imaging device, as 
is commonly used for image sensing in modern digital cameras. 

25 One or more of a series of images captured by image capture unit 110 will be 

stored at least temporarily in memory 120. For one embodiment of the present 
invention, motion detection unit 130 uses the changes between subsequent images to 
calculate an amount and direction of motion for camera 100. There are many 
techniques known in the art for calculation of motion based upon changes in captured 

30 images. One such method is described in United States Patent 5,808,678, Yuji 

Sakaegi, entitled "Method and Apparatus for Designing a Position on a View Finder 
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Based on Motion Detection", which issued September 15, 1998. Another such 
method is described in United States Patent 5,786,804, Gary B, Gordon, entitled 
"Method and System for Tracking Attitude", which issued July 28, 1998. 



5 Note that, although the system of Figure 1 teaches the use of one image 

capture unit 110, for an alternative embodiment, a first image capture unit can be used 
for capture of the digital picture taken by the camera and separate image capture unit 
can be used for the motion detection. 



10 Also note that, for another embodiment of the present invention, motion 

detection is not performed optically by comparing subsequent images. Instead, for 
these embodiments, non-optical motion sensing techniques that are also well known in 
the art are used. One such method would be to use gyroscopes as described, for 
example, in United States patent 5,825,350, Case, Jr. et al., "Electronic Pointing 

15 Apparatus and Method", which issued October 20, 1998. 

As will be described below in greater detail, control unit 140 causes merge unit 
150 to combine the motion detection information with the captured image and then 
this merged information is displayed on display 160. For example, a cursor and a set 

20 of icons, such as thumbnail images, could be merged with the series of images being 

captured by capture unit 110. Motion of the camera 100 would be detected and cause 
the thumbnail images to move within the display. When the desired icon moves under 
the cursor, the user could select this target icon by using selection unit 170. It is 
preferred that selection unit 170 be a switch on the camera 100. However, other forms 

25 of selection, such as voice command detection, are known in the art and could be 

employed alternatively. 



30 



Examples of suitable displays 160 include viewfinder micro displays such as are 
manufactured by the MicroDisplay Corporation, San Pablo, California, USA, or by 
Displaytech, of Longmont, Colorado, USA. Although it is preferred that display 160 
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be a view finder micro display, there are many forms of suitable displays such as panel 
displays that are well known in the art. 



Figure 2 is a diagram illustrating a digital imaging system having a pointing 
5 device-based graphical user interface camera according to the present invention. In 

figure 2, camera 100 is shown coupled to external device 210. The coupling can be 
accomplished using wire cable or fiber optic links. The coupling can also be 
accomplished using a wireless link such as infrared or radio links. External device 210 
can include any of the many known external devices that are commonly associated with 
10 digital cameras such as a computer, external memory, modem, or printer. It is to be 

understood, however, that digital camera 100 need not be linked to external device 
210 for the present invention to be practiced. 

In figure 2 it can be seen that for this embodiment, camera 100 has a display 
15 160 and three selection buttons 170A, 170B and 170C. Note that image capture unit 

180 is shown in figure 2 as being shaded because the image capture unit is generally 
located on the side of the camera opposite to the side having the display 160. 

For this embodiment, three selection buttons, 170 A, 170B and 170C, are 
20 shown. For this example, selection button 170 A is used to operate an optical or 

electronic zoom. Buttons 170B and 170C are used together in an application-specific 
manner. For example, button 170C can be used to enter a particular mode, such as 
thumbnail image selection. In the thumbnail image selection mode, button 170B can 
then be used to select a particular thumbnail image when the camera motion causes the 
25 target thumbnail icon to be moved under the cursor. 

Note that this arrangement of buttons makes it easy to use camera 100 as a 
gun-sight-like pointing device within a graphical user interface. Digital cameras have 
not generally used pointing devices to interact with the interface presented on the 
30 display. Typically, they use a set of push buttons to step through menus and to select 

images from memory for display and deletion. To view a micro display, the user needs 
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to hold the display close to his or her eye and view the display through an eyepiece. 
This arrangement makes the interface controls more difficult to use, because the user 
will not be able to see the controls while viewing the display, 

5 The present invention allows the user to interact with the information display in 

a way similar to the computer mouse. For one embodiment of the present invention, 
the entire body of the camera is moved, and the movement of the camera is recorded. 
The motion information can then be used to position a cursor, or to position graphic 
elements. For example, graphic elements can be positioned so they stay fixed relative 
10 to the world as the user moves the camera. 



With most digital still cameras, the user can load a previously captured image 
to the display by selecting it from a grid of low-resolution ("thumbnail") images. The 
thumbnail is selected by pressing buttons that move a cursor across the thumbnails 
15 until the desired picture is under the cursor. With the new method, the user can look 

into a micro display and will be presented with the thumbnails. A computer within the 
camera can continuously reposition the thumbnails so they appear to be fixed relative 
to the world. The user can then select a thumbnail by simply pointing the camera at 
the desired thumbnail. 

20 

For one embodiment of the present implementation, the position of the camera 
is tracked by optical flow. The camera records a sequence of images. By comparing 
the images with each other, the motion of the camera can be estimated. Determining 
the motion of the camera by comparing sequential images taken with the camera is well 
25 described in the literature, and this approach has the advantage of not requiring any 

additional hardware. Alternative implementations use sensors such as gyroscopes, tilt 
sensors, compasses, or a GPS receiver to measure the position of the camera. These 
solutions may be more robust, but may also be more expensive to implement. 



30 
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Using the camera like a mouse 



Figures 3 a and 3b illustrate use of the camera as a pointing device to select 
thumbnail images according to an embodiment of the present invention. In figure 3 a, a 
5 sheet of thumbnail images is shown superimposed on a view through the camera. The 

cross hair is a cursor, and for one embodiment, the cursor is always fixed relative to 
the camera, e.g., the cross hair cursor is fixed in the center of the view. The sheet of 
thumbnail images is fixed relative to the world by using motion tracking. That is, the 
computer constantly repositions the sheet as the camera moves, so the sheet seems to 
10 be fixed in position relative to the objects seen through the camera. As shown in figure 

3b, when the user moves the camera, the cursor moves relative to the world and to the 
world-fixed thumbnails. This allows the user to select an image by simply pointing the 
camera at the desired image. The camera itself is used as the only pointing device. No 
other mouse, joystick or other device need be used to move the cursor. 

15 

How it works 



Figure 4 is a diagram illustrating how the thumbnail images of Figures 3a and 
3b are made to appear to be motionless relative to objects of the scene. Motion 
20 tracking sofl:ware tracks the motion of image features in the scene. For example, the 

image of the computer monitor on the desk moved down and slightly right between 
fi-ame 1 and frame 2. The sheet of thumbnails is moved by the same amount, and in 
the same direction, as the features in the scene. The sheet thus appears to be 
motionless relative to the objects in the scene (such as the computer monitor). 

25 

Because the thumbnails appear fixed relative to the world, the user can use the 
camera like a gun-sight. The cross hairs stay fixed relative to the camera, and the sheet 
of thumbnails stays fixed relative to the world, so the user can place the cross hairs on 
the desired thumbnail by simply aiming the camera. This feature provides a very 
30 simple to use and intuitive user interface. 
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The viewfmder display may be a micro display that is viewed directly through 
some optics. Such a display has inherit advantages over a panel display, because it is 
typically brighter, higher resolution, has more colors, subtends a larger viewing angle, 
and requires less power. In one viewing mode, the operator of the camera can see the 
5 display at the same time as the scene. The display can be partially transparent, be 

optically mixed with the world by means of a beamsplitter, or digitally mixed with an 
image captured with the camera. 

In a second alternative mode, the direct view of the scene is closed off, perhaps 
10 by means of a shutter. In this mode only the images on the display can be seen. There 

could also be other alternative modes where part of the scene is masked off, and in 
these regions only the display can be seen. For example, the operator could view a 
mixture of an optical view of the scene with graphics in the top half of the display, and 
only graphical status information against a black background in the bottom half of the 
15 display. The masking can even be done with an electronic element, where the display 

information can be made to appear as an opaque overlay to the optical view of the 
scene. 

The motion tracking keeps track of the camera's angular position in the world. 
20 As previously described, this can be done by tracking motion using the camera's light 

sensors, or it could be done with other instruments such as a compass, a gyroscope, a 
GPS sensor, or the like. 

Virtual Selection 

25 

For one embodiment, the camera is used to select positions or regions of the 
scene. The operator simply points the camera at objects or locations in the scene, and 
then uses a button or the like to indicate the selection. These regions can then be used 
to assist in the capture or processing of the image. 

30 
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Figures 5a and 5b illustrate use of the camera as a pointing device to select a 
portion of the scene according to an embodiment of the present invention. For 
example, a rectangular region that is larger than the viewfinder of the camera can be 
selected by marking two opposite corners of the region. In this example, the selected 
5 rectangle is the dotted rectangle of figure 5b. The viev^mder is illustrated by the solid 

rectangle, and the cross-shaped cursor is used to select the first corner of the region in 
figure 5a, and the second, diagonal corner of the region in figure 5b. Note that 
alternative shaped areas can be designated. For example, two points could be specified 
to define a center and radius to designate a circular region, or N points could be 
10 chosen to specify an N-sided polygonal region. 



Regardless of its shape, the region can be used for several purposes. It can 
delimit the boundaries of a region to be captured using multiple tiled images. It can be 
a region that is supposed to receive special processing, such as reduced image 
15 compression to preserve important details. It can also be used to change the zoom, so 

the camera can capture the framed region without any waste due to cropping. 

Selected locations can be fixed in space by tracking the camera's movement. 
Alternatively, moving selected targets can be tracked by means such as motion 
20 tracking. For example, a soccer player's face could be selected. Motion tracking 

would then track the face, and the focus could automatically be adjusted to keep this 
face in focus. 



Important scene locations that would aid in image capture can also be marked. 

25 For example, the light source can be marked, and this information can greatly aid color 

correction or other image processing. Note that the light source need not be located 
within the image to be photographed. For one embodiment, the photographer can 
collect information for image processing by pointing the camera at the light source (or 
sources), either before or after capturing the image. For an alternative embodiment, 

30 the subject can be marked for auto-focus. Areas of the view can also be marked as 

triggers, where image motion in a trigger area will make the camera take a picture. 
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For example, a tripod-mounted camera could be set to take a picture if motion is 
detected crossing the finish line of a racetrack. 



Heads-up information 

5 

As shown in figure 6, a vicAvfinder display that has look-through capability can 
display information that is usually presented on a small status-display. It can show the 
state of the flash, the amount of storage remaining, the degree of compression, and the 
like. If the user requires more information, the cursor can easily be moved over the 

10 status display to select a more detailed display of information. The information is 

easier to access from the viewfmder display, because it can be seen while the picture is 
being framed. When using the virtual selection described above, the heads-up display 
can show the user the region or locations that have been selected. Figure 7 is a 
diagram illustrating use of heads-up data during guided swipe of a panoramic scene 

15 according to an embodiment of the present invention. In this example of capturing a 

large region with multiple tiled images, the camera can show the operator the selected 
region (the dashed rectangle), the area of the selected region that had already been 
captured (slightly darkened), and instructions on which way to point the camera to 
capture the unrecorded parts of the region (the left arrow). 

20 

Virtual review 



With motion tracking and a viewfinder display, the operator can be presented 
with a virtual panorama. Figure 8 is a diagram illustrating tracking during virtual 

25 review of the panoramic scene according to an embodiment of the present invention. 

After capture and tiling to form an oversized image, such as a panorama, the user can 
view the panorama by looking into the viewfmder. Moving the camera will cause the 
panorama (the dashed rectangle) to move in the opposite direction in the camera, thus 
giving the impression that a large scene is being viewed through the window of the 

30 viewfmder (the solid rectangle). The operator will feel immersed in the panoramic 

scene. Alternatively, images that have more pixels than the micro display can show 



can be displayed- 
image. 
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The operator simply moves the camera to view different parts of the 



Image manipulation 

5 

The combination of a high-resolution colorful viewfinder display with a camera 
permits the camera to be used for image manipulations such as cropping, color 
correction and page layout. Figure 9 is a diagram illustrating image manipulation 
according to an embodiment of the present invention. In this example, the cursor can 
10 be used to adjust the contrast, brightness or hue of the selected image by dragging the 

slider for the appropriate icon. 



Figures 10a and 10b illustrate use of the camera as a pointing device to select 
thumbnail images for high resolution page layout according to an embodiment of the 
15 present invention. The cursor is used to select thumbnail images in Figure 10a. The 

cursor is then used in figure 10b to select a page layout style and to cause the resulting 
image to be sent to a printer for printing. 

One advantage to performing these operations on the camera instead of after 
20 downloading the images to the computer is that the processing can be done before 

image compression. Some operations can also reduce the size of the image, which will 
thereby reduce the storage requirements for the image. For example, regions that were 
discarded when an image was cropped would not need to be stored on the camera. 
Further, this can eliminate the need for an external computer altogether. The images 
25 can be sent directly to the printer or other external device. 



Super-resolution and Stereoscopic imaging 



30 



If the position of the camera is very precisely known, a higher resolution image 
can be synthesized from several images taken with slightly different locations. 
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Also, by tracking the camera's position and possibly even guiding the operator to the 
correct position, a second image could be captured at a location that provides a good 
stereoscopic pair to the first image. The camera could also be used as a stereoscopic 
display device if it had two viewfmder displays. Alternatively, if the camera had two 
5 capture devices, stereoscopic images could be captured more easily, and stereoscopic 

panoramas could be captured. These panoramas could be reviewed with stereoscopic 
view^nders in the virtual mode previously described. 



Games 

10 

By having computer graphics combined with an optical view of the scene, new 
types of games would be possible. Game elements could be superimposed on the view 
of the scene, and motion tracking of the camera could be used to position the elements 
so they stay fixed relative to the scene. For example, a computer graphic image of a 
15 ball could be launched from the camera. It could then be made to appear as if the ball 

had hit an object in the scene. The place where the ball had hit could be marked with 
flirther graphics. 



Tracking position 

20 

If the full position of the camera in multiple dimensions is collected, by means 
of GPS for example, this information can be used to automatically record where and 
when the picture was taken. Any information on the angular position of the camera, 
the time of day, and the geographic location of the camera can also be used for color 
25 correcting the image. For example, if the picture were taken at night, the camera 

would not use color correction for daylight. Or, if it is known that the camera was 
facing north at 3 pm at a certain location, the position of the sun could be determined, 
and some useful characteristics of the sunlight could be estimated which would allow 
improved image processing. 



30 
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The many features and advantages of the invention are apparent from the 
written description and thus it is intended by the appended claims to cover all such 
features and advantages of the invention. Further, because numerous modifications 
and changes will readily occur to those skilled in the art, it is not desired to limit the 
invention to the exact construction and operation as illustrated and described. Hence, 
all suitable modifications and equivalents may be resorted to as falling within the scope 
of the invention. 



What is claimed is; 
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1 1 . A process for a camera having a display, the process comprising the 

2 steps of: 

3 displaying a cursor and a plurality of icons on the display; 

4 moving the camera; 

5 sensing motion of the camera; 

6 based on the motion, repositioning the icons in the display until the cursor is on 

7 a target icon of the plurality of icons; and 

8 selecting the target icon. 

1 2. The process as set forth in claim 1, wherein at least one of the icons is 

2 repositioned to appear to be fixed in space with regard to an image being viewed in the 

3 display. 

1 3. The process as set forth in claim 2, wherein the at least one of the icons 

2 is repositioned in a direction opposite, and of corresponding magnitude, to the motion 

3 of the camera. 

1 4. The process as set forth in claim 1, wherein the display is a viewfmder. 

1 5. The process as set forth in claim 1, wherein the motion is sensed using a 

2 non-optical motion detector. 

1 6. The process as set forth in claim 1, wherein the motion is sensed using 

2 an optical motion detector. 

1 7, The process as set forth in claim 1, wherein the target icon is a 

2 thumbnail image. 
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1 8. The process as set forth in claim 7, including the step of performing 

2 image manipulation on a high resolution image associated with the thumbnail image. 

1 9. The process as set forth in claim 8, including the step of transferring the 

2 manipulated high resolution image to a device external to the camera. 

1 10. The process as set forth in claim 1, wherein the target icon is associated 

2 with a function to be performed when the target icon is selected. 

1 11 . A process for a camera having a display, the process comprising the 

2 steps of 

3 displaying a cursor and a first portion of a scene on the display; 

4 using the cursor to select a first location within the first portion; 

5 moving the camera to display a second portion of a scene on the display; 

6 sensing motion of the camera; 

7 displaying the cursor based on the motion; and 

8 using the cursor to select a second location within the second portion such that 

9 the first and second locations define a region of the scene, the region being of greater 
10 extent than is displayed in the display, 

1 12. The process as set forth in claim 1 1, wherein an operation is performed 

2 on the region. 

1 13. The process as set forth in claim 12, wherein the operation includes the 

2 step of capturing a panoramic image having the extent of the region. 

1 14. The process as set forth in claim 13, wherein the step of capturing the 

2 panoramic image includes displaying an indicator on the display to guide movement of 

3 the camera. 
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1 15. The process as set forth in claim 12, wherein the operation includes the 

2 step of zooming the camera to display the region in the display. 

1 16. A process for a camera having a display, the process comprising the 

2 steps of: 

3 displaying a first portion of an image on the display; 

4 moving the camera; 

5 sensing motion of the camera; and 

6 based on the motion, displaying a second portion of the image on the display. 

1 17. The process as set forth in claim 16, wherein the image is a panoramic 

2 image. 

1 18. The process as set forth in claim 16, wherein the image has a resolution 

2 greater than the display. 

1 19. A camera having a display, the camera comprising: 

2 a motion sensor to sense motion of the camera; 

3 circuitry to display a cursor and a plurality of icons on the display, based on the 

4 motion, the circuitry repositioning the icons in the display until the cursor is on a target 

5 icon of the plurality of icons; and 

6 a selector to select the target icon. 

1 20. A camera having a display, the camera comprising: 

2 a motion sensor to sense motion of the camera; 

3 a selector; and 

4 circuitry to displaying a cursor and a first portion of a scene on the display, if 

5 the cursor and selector is used to select a first location within the first portion, and the 

6 camera is moved to display a second portion of a scene on the display, the circuitry 

7 displays the cursor based on the motion so that the cursor can be used to select a 

8 second location within the second portion such that the first and second locations 
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9 define a region of the scene, the region being of greater extent than is displayed in the 

10 display. 

1 21 . A camera having a display, the camera comprising: 

2 a motion sensor to sense motion of the camera; and 

3 circuitry to displaying a first portion of an image on the display, and if motion 

4 of the camera is sensed, based on the motion, the circuitry displaying a second portion 

5 of the image on the display. 
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ABSTRACT 



1 A process and apparatus is described to improve a digital camera user interface 

2 and increase ease of use and functionality of a digital camera by quickly, accurately and 

3 robustly permitting cursor control and designation in a digital camera display. A 

4 digital camera is used as a pointing device such as a mouse or trackball The motion of 

5 the camera is detected, and the motion of the camera is used to position graphic 

6 elements on the camera's own display. The camera's motion can be detected with 

7 sensors, such as gyroscopes, or the camera itself can be used as a motion sensor. One 

8 application of this involves using the camera as a computer mouse, or like a gun-sight, 

9 to select images from a sheet of low-resolution ("thumbnail") images. The motion of 

10 the camera is tracked, and the user aims at the desired image from a sheet of thumbnail 

11 images. The thumbnails appear to be fixed relative to the world because the camera 

12 can continuously reposition them in the display based upon the motion of the camera. 

13 The user can then select a thumbnail in an intuitive manner by simply pointing the 

14 camera at the desired thumbnail. For alternative embodiments, the interface can be 

15 used to select regions of greater extent than can be viewed in the viewer or to virtually 

16 review images. 
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